Is Hey Jude in the right key? Cognitive components of absolute pitch memory.

Most individuals, regardless of formal musical training, have long-term absolute pitch memory (APM) for familiar musical recordings, though with varying levels of accuracy. The present study followed up on recent evidence suggesting an association between singing accuracy and APM (Halpern & Pfordresher, 2022, Attention, Perception, & Psychophysics, 84(1), 260-269), as well as tonal short-term memory (STM) and APM (Van Hedger et al., 2018, Quarterly Journal of Experimental Psychology, 71(4), 879-891). Participants from three research sites (n = 108) completed a battery of tasks including APM, tonal STM, singing accuracy, and self-reported auditory imagery. Both tonal STM and singing accuracy predicted APM, replicating prior results. Tonal STM also predicted singing accuracy, music training, and auditory imagery. Further tests suggested that the association between APM and singing accuracy was fully mediated by tonal STM. This pattern comports well with models of vocal pitch matching that include STM for pitch as a mechanism for sensorimotor translation.

Imagined Musical Scale Relationships Decoded from Auditory Cortex.

Notes in a musical scale convey different levels of stability or incompleteness, forming what is known as a tonal hierarchy. Levels of stability conveyed by these scale degrees are partly responsible for generating expectations as a melody proceeds, for emotions deriving from fulfillment (or not) of those expectations, and for judgments of overall melodic well-formedness. These functions can be extracted even during imagined music. We investigated whether patterns of neural activity in fMRI could be used to identify heard and imagined notes, and if patterns associated with heard notes could identify notes that were merely imagined. We presented trained musicians with the beginning of a scale (key and timbre were varied). The next note in the scale was either heard or imagined. A probe tone task assessed sensitivity to the tonal hierarchy, and state and trait measures of imagery were included as predictors. Multivoxel classification yielded above-chance results in primary auditory cortex (Heschl's gyrus) for heard scale-degree decoding. Imagined scale-degree decoding was successful in multiple cortical regions spanning bilateral superior temporal, inferior parietal, precentral, and inferior frontal areas. The right superior temporal gyrus yielded successful cross-decoding of heard-to-imagined scale-degree, indicating a shared pathway between tonal-hierarchy perception and imagery. Decoding in right and left superior temporal gyrus and right inferior frontal gyrus was more successful in people with more differentiated tonal hierarchies and in left inferior frontal gyrus among people with higher self-reported auditory imagery vividness, providing a link between behavioral traits and success of neural decoding. These results point to the neural specificity of imagined auditory experiences-even of such functional knowledge-but also document informative individual differences in the precision of that neural response.

What do less accurate singers remember? Pitch-matching ability and long-term memory for music.

We have only a partial understanding of how people remember nonverbal information such as melodies. Although once learned, melodies can be retained well over long periods of time, remembering newly presented melodies is on average quite difficult. People vary considerably, however, in their level of success in both memory situations. Here, we examine a skill we anticipated would be correlated with memory for melodies: the ability to accurately reproduce pitches. Such a correlation would constitute evidence that melodic memory involves at least covert sensorimotor codes. Experiment 1 looked at episodic memory for new melodies among nonmusicians, both overall and with respect to the Vocal Memory Advantage (VMA): the superiority in remembering melodies presented as sung on a syllable compared to rendered on an instrument. Although we replicated the VMA, our prediction that better pitch matchers would have a larger VMA was not supported, although there was a modest correlation with memory for melodies presented in a piano timbre. Experiment 2 examined long-term memory for the starting pitch of familiar recorded music. Participants selected the starting note of familiar songs on a keyboard, without singing. Nevertheless, we found that better pitch-matchers were more accurate in reproducing the correct starting note. We conclude that sensorimotor coding may be used in storing and retrieving exact melodic information, but is not so useful during early encounters with melodies, as initial coding seems to involve more derived properties such as pitch contour and tonality.

Mapping Specific Mental Content during Musical Imagery.

Humans can mentally represent auditory information without an external stimulus, but the specificity of these internal representations remains unclear. Here, we asked how similar the temporally unfolding neural representations of imagined music are compared to those during the original perceived experience. We also tested whether rhythmic motion can influence the neural representation of music during imagery as during perception. Participants first memorized six 1-min-long instrumental musical pieces with high accuracy. Functional MRI data were collected during: 1) silent imagery of melodies to the beat of a visual metronome; 2) same but while tapping to the beat; and 3) passive listening. During imagery, inter-subject correlation analysis showed that melody-specific temporal response patterns were reinstated in right associative auditory cortices. When tapping accompanied imagery, the melody-specific neural patterns were reinstated in more extensive temporal-lobe regions bilaterally. These results indicate that the specific contents of conscious experience are encoded similarly during imagery and perception in the dynamic activity of auditory cortices. Furthermore, rhythmic motion can enhance the reinstatement of neural patterns associated with the experience of complex sounds, in keeping with models of motor to sensory influences in auditory processing.

Covert singing in anticipatory auditory imagery.

To date, several fMRI studies reveal activation in motor planning areas during musical auditory imagery. We addressed whether such activations may give rise to peripheral motor activity, termed subvocalization or covert singing, using surface electromyography. Sensors placed on extrinsic laryngeal muscles, facial muscles, and a control site on the bicep measured muscle activity during auditory imagery that preceded singing, as well as during the completion of a visual imagery task. Greater activation was found in laryngeal and lip muscles for auditory than for visual imagery tasks, whereas no differences across tasks were found for other sensors. Furthermore, less accurate singers exhibited greater laryngeal activity during auditory imagery than did more accurate singers. This suggests that subvocalization may be used as a strategy to facilitate auditory imagery, which appears to be degraded in inaccurate singers. Taken together, these results suggest that subvocalization may play a role in anticipatory auditory imagery, and possibly as a way of supplementing motor associations with auditory imagery.

Working memory and auditory imagery predict sensorimotor synchronisation with expressively timed music.

Sensorimotor synchronisation (SMS) is prevalent and readily studied in musical settings, as most people are able to perceive and synchronise with a beat (e.g., by finger tapping). We took an individual differences approach to understanding SMS to real music characterised by expressive timing (i.e., fluctuating beat regularity). Given the dynamic nature of SMS, we hypothesised that individual differences in working memory and auditory imagery-both fluid cognitive processes-would predict SMS at two levels: (1) mean absolute asynchrony (a measure of synchronisation error) and (2) anticipatory timing (i.e., predicting, rather than reacting to beat intervals). In Experiment 1, participants completed two working memory tasks, four auditory imagery tasks, and an SMS-tapping task. Hierarchical regression models were used to predict SMS performance, with results showing dissociations among imagery types in relation to mean absolute asynchrony, and evidence of a role for working memory in anticipatory timing. In Experiment 2, a new sample of participants completed an expressive timing perception task to examine the role of imagery in perception without action. Results suggest that imagery vividness is important for perceiving and control is important for synchronising with irregular but ecologically valid musical time series. Working memory is implicated in synchronising by anticipating events in the series.

Who's that Knocking at My Door? Neural Bases of Sound Source Identification.

When hearing knocking on a door, a listener typically identifies both the action (forceful and repeated impacts) and the object (a thick wooden board) causing the sound. The current work studied the neural bases of sound source identification by switching listeners' attention toward these different aspects of a set of simple sounds during functional magnetic resonance imaging scanning: participants either discriminated the action or the material that caused the sounds, or they simply discriminated meaningless scrambled versions of them. Overall, discriminating action and material elicited neural activity in a left-lateralized frontoparietal network found in other studies of sound identification, wherein the inferior frontal sulcus and the ventral premotor cortex were under the control of selective attention and sensitive to task demand. More strikingly, discriminating materials elicited increased activity in cortical regions connecting auditory inputs to semantic, motor, and even visual representations, whereas discriminating actions did not increase activity in any regions. These results indicate that discriminating and identifying material requires deeper processing of the stimuli than discriminating actions. These results are consistent with previous studies suggesting that auditory perception is better suited to comprehend the actions than the objects producing sounds in the listeners' environment.

That note sounds wrong! Age-related effects in processing of musical expectation.

Part of musical understanding and enjoyment stems from the ability to accurately predict what note (or one of a small set of notes) is likely to follow after hearing the first part of a melody. Selective violation of expectations can add to aesthetic response but radical or frequent violations are likely to be disliked or not comprehended. In this study we investigated whether a lifetime of exposure to music among untrained older adults would enhance their reaction to unexpected endings of unfamiliar melodies. Older and younger adults listened to melodies that had expected or unexpected ending notes, according to Western music theory. Ratings of goodness-of-fit were similar in the groups, as was ERP response to the note onset (N1). However, in later time windows (P200 and Late Positive Component), the amplitude of a response to unexpected and expected endings was both larger in older adults, corresponding to greater sensitivity, and more widespread in locus, consistent with a dedifferentiation pattern. Lateralization patterns also differed. We conclude that older adults refine their understanding of this important aspect of music throughout life, with the ability supported by changing patterns of neural activity.

Musical expertise has minimal impact on dual task performance.

Studies investigating effect of practice on dual task performance have yielded conflicting findings, thus supporting different theoretical accounts about the organisation of attentional resources when tasks are performed simultaneously. Because practice has been proven to reduce the demand of attention for the trained task, the impact of long-lasting training on one task is an ideal way to better understand the mechanisms underlying dual task decline in performance. Our study compared performance during dual task execution in expert musicians compared to controls with little if any musical experience. Participants performed a music recognition task and a visuo-spatial task separately (single task) or simultaneously (dual task). Both groups showed a significant but similar performance decline during dual tasks. In addition, the two groups showed a similar decline of dual task performance during encoding and retrieval of the musical information, mainly attributed to a decline in sensitivity. Our results suggest that attention during dual tasks is similarly distributed by expert and non-experts. These findings are in line with previous studies showing a lack of sensitivity to difficulty and lack of practice effect during dual tasks, supporting the idea that different tasks may rely on different and not-sharable attentional resources.

A Brain System for Auditory Working Memory.

The brain basis for auditory working memory, the process of actively maintaining sounds in memory over short periods of time, is controversial. Using functional magnetic resonance imaging in human participants, we demonstrate that the maintenance of single tones in memory is associated with activation in auditory cortex. In addition, sustained activation was observed in hippocampus and inferior frontal gyrus. Multivoxel pattern analysis showed that patterns of activity in auditory cortex and left inferior frontal gyrus distinguished the tone that was maintained in memory. Functional connectivity during maintenance was demonstrated between auditory cortex and both the hippocampus and inferior frontal cortex. The data support a system for auditory working memory based on the maintenance of sound-specific representations in auditory cortex by projections from higher-order areas, including the hippocampus and frontal cortex. SIGNIFICANCE STATEMENT: In this work, we demonstrate a system for maintaining sound in working memory based on activity in auditory cortex, hippocampus, and frontal cortex, and functional connectivity among them. Specifically, our work makes three advances from the previous work. First, we robustly demonstrate hippocampal involvement in all phases of auditory working memory (encoding, maintenance, and retrieval): the role of hippocampus in working memory is controversial. Second, using a pattern classification technique, we show that activity in the auditory cortex and inferior frontal gyrus is specific to the maintained tones in working memory. Third, we show long-range connectivity of auditory cortex to hippocampus and frontal cortex, which may be responsible for keeping such representations active during working memory maintenance.

Attentional flexibility and memory capacity in conductors and pianists.

Individuals with high working memory (WM) capacity also tend to have better selective and divided attention. Although both capacities are essential for skilled performance in many areas, evidence for potential training and expertise effects is scarce. We investigated the attentional flexibility of musical conductors by comparing them to equivalently trained pianists. Conductors must focus their attention both on individual instruments and on larger sections of different instruments. We studied students and professionals in both domains to assess the contributions of age and training to these skills. Participants completed WM span tests for auditory and visual (notated) pitches and timing durations, as well as long-term memory tests. In three dichotic attention tasks, they were asked to detect small pitch and timing deviations from two melodic streams presented in baseline (separate streams), selective-attention (concentrating on only one stream), and divided-attention (concentrating on targets in both streams simultaneously) conditions. Conductors were better than pianists in detecting timing deviations in divided attention, and experts detected more targets than students. We found no group differences for WM capacity or for pitch deviations in the attention tasks, even after controlling for the older age of the experts. Musicians' WM spans across multimodal conditions were positively related to selective and divided attention. High-WM participants also had shorter reaction times in selective attention. Taken together, conductors showed higher attentional flexibility in successfully switching between different foci of attention.

The speed of our mental soundtracks: Tracking the tempo of involuntary musical imagery in everyday life.

The study of spontaneous and everyday cognitions is an area of rapidly growing interest. One of the most ubiquitous forms of spontaneous cognition is involuntary musical imagery (INMI), the involuntarily retrieved and repetitive mental replay of music. The present study introduced a novel method for capturing temporal features of INMI within a naturalistic setting. This method allowed for the investigation of two questions of interest to INMI researchers in a more objective way than previously possible, concerning (1) the precision of memory representations within INMI and (2) the interactions between INMI and concurrent affective state. Over the course of 4 days, INMI tempo was measured by asking participants to tap to the beat of their INMI with a wrist-worn accelerometer. Participants documented additional details regarding their INMI in a diary. Overall, the tempo of music within INMI was recalled from long-term memory in a highly veridical form, although with a regression to the mean for recalled tempo that parallels previous findings on voluntary musical imagery. A significant positive relationship was found between INMI tempo and subjective arousal, suggesting that INMI interacts with concurrent mood in a similar manner to perceived music. The results suggest several parallels between INMI and voluntary imagery, music perceptual processes, and other types of involuntary memories.

Feel the Noise: Relating Individual Differences in Auditory Imagery to the Structure and Function of Sensorimotor Systems.

Humans can generate mental auditory images of voices or songs, sometimes perceiving them almost as vividly as perceptual experiences. The functional networks supporting auditory imagery have been described, but less is known about the systems associated with interindividual differences in auditory imagery. Combining voxel-based morphometry and fMRI, we examined the structural basis of interindividual differences in how auditory images are subjectively perceived, and explored associations between auditory imagery, sensory-based processing, and visual imagery. Vividness of auditory imagery correlated with gray matter volume in the supplementary motor area (SMA), parietal cortex, medial superior frontal gyrus, and middle frontal gyrus. An analysis of functional responses to different types of human vocalizations revealed that the SMA and parietal sites that predict imagery are also modulated by sound type. Using representational similarity analysis, we found that higher representational specificity of heard sounds in SMA predicts vividness of imagery, indicating a mechanistic link between sensory- and imagery-based processing in sensorimotor cortex. Vividness of imagery in the visual domain also correlated with SMA structure, and with auditory imagery scores. Altogether, these findings provide evidence for a signature of imagery in brain structure, and highlight a common role of perceptual-motor interactions for processing heard and internally generated auditory information.

Right parietal cortex mediates recognition memory for melodies.

Functional brain imaging studies have highlighted the significance of right-lateralized temporal, frontal and parietal brain areas for memory for melodies. The present study investigated the involvement of bilateral posterior parietal cortices (PPCs) for the recognition memory of melodies using transcranial direct current stimulation (tDCS). Participants performed a recognition task before and after tDCS. The task included an encoding phase (12 melodies), a retention period, as well as a recognition phase (24 melodies). Experiment 1 revealed that anodal tDCS over the right PPC led to a deterioration of overall memory performance compared with sham. Experiment 2 confirmed the results of Experiment 1 and further showed that anodal tDCS over the left PPC did not show a modulatory effect on memory task performance, indicating a right lateralization for musical memory. Furthermore, both experiments revealed that the decline in memory for melodies can be traced back to an interference of anodal stimulation on the recollection process (remember judgements) rather than to familiarity judgements. Taken together, this study revealed a causal involvement of the right PPC for memory for melodies and demonstrated a key role for this brain region in the recollection process of the memory task.

Musical tasks targeting preserved and impaired functions in two dementias.

Studies of musical abilities in dementia have for the most part been rather general assessments of abilities, for instance, assessing retention of music learned premorbidly. Here, we studied patients with dementias with contrasting cognitive profiles to explore specific aspects of music cognition under challenge. Patients suffered from Alzheimer's disease (AD), in which a primary impairment is in forming new declarative memories, or Lewy body disease (PD/LBD), a type of parkinsonism in which executive impairments are prominent. In the AD patients, we examined musical imagery. Behavioral and neural evidence confirms involvement of perceptual networks in imagery, and these are relatively spared in early stages of the illness. Thus, we expected patients to have relatively intact imagery in a mental pitch comparison task. For the LBD patients, we tested whether executive dysfunction would extend to music. We probed inhibitory skills by asking for a speeded pitch or timbre judgment when the irrelevant dimension was held constant or also changed. Preliminary results show that AD patients score similarly to controls in the imagery tasks, but PD/LBD patients are impaired relative to controls in suppressing some irrelevant musical dimensions, particularly when the required judgment varies from trial to trial.

The effect of exercise-induced arousal on chosen tempi for familiar melodies.

Many previous studies have shown that arousal affects time perception, suggesting a direct influence of arousal on the speed of the pacemaker of the internal clock. However, it is unknown whether arousal influences the mental representation of tempo (speed) for highly familiar and complex stimuli, such as well-known melodies, that have long-term representations in memory. Previous research suggests that mental representations of the tempo of familiar melodies are stable over time; the aim of the present study was to investigate whether these representations can be systematically altered via an increase in physiological arousal. Participants adjusted the tempo of 14 familiar melodies in real time until they found a tempo that matched their internal representation of the appropriate tempo for that piece. The task was carried out before and after a physiologically arousing (exercise) or nonarousing (anagrams) manipulation. Participants completed this task both while hearing the melodies aloud and while imagining them. Chosen tempi increased significantly following exercise-induced arousal, regardless of whether a melody was heard aloud or imagined. These findings suggest that a change in internal clock speed affects temporal judgments even for highly familiar and complex stimuli such as music.

Common parietal activation in musical mental transformations across pitch and time.

We previously observed that mental manipulation of the pitch level or temporal organization of melodies results in functional activation in the human intraparietal sulcus (IPS), a region also associated with visuospatial transformation and numerical calculation. Two outstanding questions about these musical transformations are whether pitch and time depend on separate or common processing in IPS, and whether IPS recruitment in melodic tasks varies depending upon the degree of transformation required (as it does in mental rotation). In the present study we sought to answer these questions by applying functional magnetic resonance imaging while musicians performed closely matched mental transposition (pitch transformation) and melody reversal (temporal transformation) tasks. A voxel-wise conjunction analysis showed that in individual subjects, both tasks activated overlapping regions in bilateral IPS, suggesting that a common neural substrate subserves both types of mental transformation. Varying the magnitude of mental pitch transposition resulted in variation of IPS BOLD signal in correlation with the musical key-distance of the transposition, but not with the pitch distance, indicating that the cognitive metric relevant for this type of operation is an abstract one, well described by music-theoretic concepts. These findings support a general role for the IPS in systematically transforming auditory stimulus representations in a nonspatial context.

Auditory imagery and the poor-pitch singer.

The vocal imitation of pitch by singing requires one to plan laryngeal movements on the basis of anticipated target pitch events. This process may rely on auditory imagery, which has been shown to activate motor planning areas. As such, we hypothesized that poor-pitch singing, although not typically associated with deficient pitch perception, may be associated with deficient auditory imagery. Participants vocally imitated simple pitch sequences by singing, discriminated pitch pairs on the basis of pitch height, and completed an auditory imagery self-report questionnaire (the Bucknell Auditory Imagery Scale). The percentage of trials participants sung in tune correlated significantly with self-reports of vividness for auditory imagery, although not with the ability to control auditory imagery. Pitch discrimination was not predicted by auditory imagery scores. The results thus support a link between auditory imagery and vocal imitation.

Dynamic aspects of musical imagery.

Auditory imagery can represent many aspects of music, such as the starting pitches of a tune or the instrument that typically plays it. In this paper, I concentrate on more dynamic, or time-sensitive aspects of musical imagery, as demonstrated in two recently published studies. The first was a behavioral study that examined the ability to make emotional judgments about both heard and imagined music in real time. The second was a neuroimaging study on the neural correlates of anticipating an upcoming tune, after hearing a cue tune. That study found activation of several sequence-learning brain areas, some of which varied with the vividness of the anticipated musical memory. Both studies speak to the ways in which musical imagery allows us to judge temporally changing aspects of the represented musical experience. These judgments can be quite precise, despite the complexity of generating the rich internal representations of imagery.

Neuronal correlates of perception, imagery, and memory for familiar tunes.

We used fMRI to investigate the neuronal correlates of encoding and recognizing heard and imagined melodies. Ten participants were shown lyrics of familiar verbal tunes; they either heard the tune along with the lyrics, or they had to imagine it. In a subsequent surprise recognition test, they had to identify the titles of tunes that they had heard or imagined earlier. The functional data showed substantial overlap during melody perception and imagery, including secondary auditory areas. During imagery compared with perception, an extended network including pFC, SMA, intraparietal sulcus, and cerebellum showed increased activity, in line with the increased processing demands of imagery. Functional connectivity of anterior right temporal cortex with frontal areas was increased during imagery compared with perception, indicating that these areas form an imagery-related network. Activity in right superior temporal gyrus and pFC was correlated with the subjective rating of imagery vividness. Similar to the encoding phase, the recognition task recruited overlapping areas, including inferior frontal cortex associated with memory retrieval, as well as left middle temporal gyrus. The results present new evidence for the cortical network underlying goal-directed auditory imagery, with a prominent role of the right pFC both for the subjective impression of imagery vividness and for on-line mental monitoring of imagery-related activity in auditory areas.